Color Superfluidity and "Baryon" Formation in Ultracold Fermions 



Akos Rapp^'^, Gergely Zarand^'^, Carsten Honerkamp'^ , and Walter Hofstetter^ 
^ Theoretical Physics Department, Institute of Physics, 
Budapest University of Technology and Economy, Budapest, H-1521, Hungary, 
^ Institut fiir Theoretische Festkorperphysik, Universitdt Karlsruhe, D-76128 Karlsruhe, Germany, 
^ Theoretical Physics, Universitdt Wurzburg, D-97074 Wiirzburg, Germany 
* Institut fiir Theoretische Physik, Johann Wolfgang Goethe- Universitdt, 60438 Frankfurt/ Main, Germany 

(Dated: February 6, 2008) 

We study fermionic atoms of three different internal quantum states (colors) in an optical lattice, 
which are interacting through attractive on site interactions, U < 0. Using a variational calculation 
for equal color densities and small couplings, \U\ < \Uc\, a color superfluid state emerges with a 
tendency to domain formation. For \U\ > \Uc\, triplets of atoms with different colors form singlet 
fermions (trions) . These phases are the analogies of the color superconducting and baryonic phases in 
QCD. In ultracold fermions, this transition is found to be of second order. Our results demonstrate 
that quantum simulations with ultracold gases may shed light on outstanding problems in quantum 
field theory. 

PACS numbers: 03.75.Mn , 32.80.Pj, 71.35.Lk 



The achievement of Bose-Einstein condensation (BEG) 
a decade ago has opened the new field of ultracold atomic 
physics where dilute alkali-metal gases are cooled into the 
quantum degenerate regime In_particular, degener- 
ate Fermi gases have been realized [2| with temperatures 
down to T/Tp « 0.05. An attractive feature of these 
systems is the high degree of tunability. Feshbach res- 
onances allow atomic interaction strengths to be tuned 
while optical lattices can be used to create artificial 
crystals of light in which atoms form Bloch bands like 
electrons in solids 0, SSl- Moreover, the effective inter- 
action strength can be modulated by the optical lattice 
alone and thus tuned through quantum phase transitions 
like the bosonic Mott transition Q. Recently, fermionic 
"''"K atoms have been loaded into optical lattices as well 
• It has been predicted that quantum simulations with 
cold fermions in optical lattices may ultimately shed light 
on complex solid-state phenomena like high-temperature 
superconductivity In a different line of experiments, 
fermionic superfluids close to the BEG-BGS transition 
have been created and even loaded into optical lattices 
0> [lot ■ Very recently, also pairing of fermions with un- 
equal spin densities and the eventual breakdown of su- 
perfluidity has been studied [ll|. 

More generally, with the degrees of freedom offered by 
cold atoms, it is possible to create new states of matter 
which have no equivalent in condensed matter. While 
typical electronic systems have at most SU(2) spin ro- 
tational symmetry, the atomic total angular momentum 
F can be larger than 1/2, resulting in 2F + 1 hyper- 
fine states. In optical traps, all of these states can be 
trap ped, e.g., for spinor condensates of ^'^Na and ®^Rb 
[12l |. For fermionic atoms, coexistence of 3 different hy- 
perfine states of '*'^K in an optical trap has been demon- 
strated llj. 



Here, we study optical lattices loaded with fermionic 
atoms that possess three different internal quantum num- 
bers (colors), a = 1 ... 3 and interact through an attrac- 
tive on-site interaction. This system is well described by 
a SU(3) Hubbard Hamiltonian. For small interactions a 
color superfluid (CSF) state appears with a triplet or- 
der parameter [1J|. Here we show that for low fillings 
and larger interactions a quantum phase transition takes 
place from the superfluid state to a Fermi liquid phase, 
where groups of three fermions bind together to form tri- 
ons. This transition is closely analogous to the one con- 
jectured in QCD, where at large quark densities, a color 
superconducting state is expected while at low densities, 
baryonic matter emerges. 



Such an optical system can be realized, e.g., by loading 
^Li atoms of nuclear spin / = 1 into an optical lattice and 
applying a magnetic field that is larger than the hyperfine 
coupling. In this case, the electron spin of the Li atom is 
essentially polarized along the external field direction and 
the 2/ + 1 nuclear quantum numbers provide the internal 
degrees of freedom. Attractive interactions independent 
of the nuclear spin are induced by an anomalously large 
and negative triplet scattering length as = — 2160ao [l5|. 
We expect the experimentally accessible temperatures for 
this three-state ensemble to be in the same range as for 
two-component mixtures, i.e., TjTp k. 0.05 0. In the 
absence of spin-flip processes, the densities of the three 
"color" states can be adjusted independently by radiofre- 
quency sweeps and selective evaporation 



In an optical lattice the atoms experience a periodic 
potential V[x) = Vb ^i^^ y ^ cos^ (kxi), with k the wave 
vector of the laser and the directions labeled by L At low 
fillings, this system can be described with good accuracy 
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by the Hubbard Hamiltonian 



(1) 



Here fiiQ = c\^Cia measures the number of fermions with 
color a at site i, with the creation operator of a 
fermion. The interaction U is assumed to be negative 
throughout this Letter while the ratio \U\/t can be tuned 
in a wide range by changing the depth Vb of the optical 
lattice. In Eq. ([T]) , we also assume a homogeneous optical 
lattice, and neglect to a first approximation the parabolic 
confinement potential of the atom trap. Note that Eq. ([T|) 
has an SU(3) symmetry associated with global rotations, 
Cia — *■ ^pUapCifj, and H conserves the total number of 

particles of each color. Na = X]j "-m- For ^Li in a strong 
magnetic field, this symmetry arises because the inter- 
action between the atoms is mediated by electronic van 
der Waals forces, which are independent of the nuclear 
degrees of freedom. 

For small values of the attractive interaction has 

been shown to induce a superfluid state at T = [ij] . In 
this state, fermions are paired to form Cooper pairs with 
an order parameter Aq,^ = {ciaCip) which transforms ac- 
cording to the adjoint representation 3 of SU(3). For 
very large values of |C/|/t, however, perturbation theory 
in the hopping t predicts a state of entirely different na- 
ture: Here three atoms tend to form a composite object, 
a local bound color singlet of energy 3U, which can hop 
between neighboring sites with an amplitude toff ^ /U'^ 
and interact repulsively to form a Fermi liquid at very low 
temperatures. Note that the symmetry of the superfluid 
and the trionic state is different; therefore, there must be 
a phase transition that separates them. As we shall see, 
this transition is of second order, and the two states are 
separated by a quantum critical point. 

The above transition occurs at intermediate values of 
U/t, where neither perturbation theory nor diagram- 
matic approaches can be applied successfully. We there- 
fore use a variational approach in the high-dimensional 
limit d oo. As a variational ansatz at T = 0, we use a 
Gutzwiller-projected wave function \G) = ni5*'I^C'S') , 
where \BCS) is a ECS superfluid state with two out of 
three color states paired 



\BCS)= n c+allK 



k2 



and Pg = riiff*' = njl + (.9 - I)nii?^i2ni3] is a gen- 
eralized Gutzwiller projector that favors triply occu- 
pied states for large values of the variational parame- 
ter g. Without making a restriction, we have assumed 
in Eq. ^ that only the A12 = — A21 components of 
the order parameter are non-zero. This corresponds to 
a particular gauge of the pairing field [l3|. The fac- 
tors Uk and denote the usual ECS coherence factors. 



1 + Ck/ + A2) and i;k = yr 



u^, with 



cos ki the kinetic en- 



"k - 

?k = ek - and ek = -'2tJ2'i=i 
ergy of the atoms on the lattice. 

For Til ~ n2 — n^, one can gain energy in the superfluid 
state by transferring particles to the channels where the 
superfluid condensate forms. Therefore, for a given total 
density n, the CSF has a global energy minimum for 
slightly unequal densities, ni = 712 7^ 713. In Eq. we 
therefore introduced different chemical potentials for the 
first two and the third channel, /ii2 7^ /is. Note, however, 
that /ii2 7^ fJ.3 are not our variational parameters; they 
are just used to fix the total density n = ("-ia) and 

«3 = (?^^3)• 

To obtain our variational estimate for the energy, we 
need to evaluate the expectation value of the Hamilto- 
nian, E{A, g, 71,123) = {G\H\G)/ {G\G), and minimize it 
with respect to the independent parameters A, g and 713 
for a given density n. To compute quantities of the form 
(0)g = (BCSIPgOPgIBCS), we first expand the prod- 
uct Pg = Ylii^ + {g — ^)ti] and rewrite PgOPg so that no 
operator occurs to the right of the corresponding an- 
nihilation operator, Cia- We can then use Wick's theorem 
to evaluate the expectation value and recast it in terms 
of a Grassmannian effective field theory with action: 



(3) 



Here ti — Y\^CiaCion with Cia a Grassman field, and 
= {cia,C0) denotes a "Nambu spinor". The ex- 
pectation value of the particle density is given by 
{ctaCia)G = (riia) s " u{ti) g , whilc the average of terms 
occurring in the kinetic and interaction energy are given 

by Ea(ci,Cja>G = Ea(c«aCja[l ' (1 ^ g){dia + dja) + 

{l-g)'^{diadja + Sijdia)])s, and {nianii3)G = {nianip)s- 
u{ti)s, with Uia = CiaCia and dia = H/^^a'^iP- The 
Gutzwiller projector manifests in Eq. ^ as an effective 
interaction, u = 1 — g^, which is attractive for trionic 
correlations {g > 1). The propagator Dq is given by 



Gq Fq 

Frt — Gn 



(4) 
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with Gg = 

Similar to 



CirvC 



)bcs and F^'^. 



jpiaub ^ Qij =^ -{CiaCjf3)BCS- 

we can derive identities that relate all 



)|0) , (2) expectation values above to the full Green's function, 
Dij = -{'ii^j)s of the effective field theory. While 



we cannot compute Dij analytically in finite dimensions, 
a great simplification occurs in the d —^ oo limit with 
t = t*/^/d (and t* ~ fixed), where the self energy be- 
comes completely local jT^. In this limit, we can obtain 
Dij and thus compute £^(A, g, n, 77.3) exactly, by deriv- 
ing self-consistent integral equations us ing an approach 
similar to dynamical mean field theory |l6l . . 

The upper panel in Fig. [T] summarizes our results for 
the filling g = n/3 = 1/3. We show the condensation 
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energy per lattice site, defined as the energy difference 
between tlie superfluid state and the minimum energy 
state for the same filling and A = 0. For \U\ < \Uc\ ~ 
— 1.774<*, the minimum occurs at finite values of A and 
g > 1; thus, we find a CSF with built-in three-body 
correlations. As expected, the energy of the CSF has a 
minimum with ni = n2 > n^. In other words, the 'spin 
operators' defined in terms of the the Gell-Mann matrices 
as cjA^Ci, tend to acquire a non-zero value, and the CSF 
becomes also "ferromagnetic" . With an equal number of 
atoms of each color, this implies phase separation; that is, 
superfluid domains will form with the order parameter in 
each domain "pointing" in a different direction [l8| . This 
tendency to form domains can also be captured through 
a Ginzburg-Landau analysis, to be discussed in a future 
publication 17[ . Note that ferromagnetism appears only 
as a secondary order parameter, since the transition is 
driven by the local superfluid correlations. 

The transition temperature Tc associated with the for- 
mation of the CSF is related to the condensation energy, 
-E-cond- As shown in Fig.[Tl i?cond initially increases with 
\U\; however, it goes to zero as one approaches the critical 
value, U Uc- At this point, the order parameter A 
also scales continuously to 0; thus, the point U = Uc 
is a quantum critical point. At U — s- Uc, the varia- 
tional parameter g diverges, and \G) reduces to a linear 
combination of states having trions (or no particles at 
all) at each lattice point. This g ^ oo state provides 
the solution of minimum energy for the whole region 
\U\> \Uc\- Note also that in the high-dimensional limit, 
the effective hopping amplitude of the trions vanishes 
as ~ l/d'^/^. Therefore, trions are immobile in d = oo 
dimensions, and the energy of the trionic state is sim- 
ply Etrion/ L = nU = 3£i?7, with L the number of lattice 
sites. In d = oo, the trionic state has also a finite residual 
entropy. This entropy is, however, immediately removed 
once one considers a finite dimensional system where tri- 
ons can hop with some effective hopping <off 7^ 0: Then 
trions are expected to form a Fermi liquid with a Fermi 
temperature T*. We expect the Fermi temperature to 
scale to in finite dimensional lattices as one approaches 
Uc from the trionic side. As shown in the inset of Fig. [U 
the deviation from equal densities ( "ferromagnetic polar- 
ization"), bn^ = Q — n-i, also vanishes o&U ^Uc, since 
the condensation energy that drives the accumulation of 
particles in the superfluid channels goes to zero at Uc- 

This picture might, in principle, be modified through 
the intrusion of other phases. However, except for the 
half-filled fully-nested case not discussed here, there arc 
no indications for this. At weak coupling, functional 
renormalization group 



14| 



does not detect any other 
instabilities. The trionic repulsive Fermi liquid is ap- 
parently also stable, except possibly at p « 1/2, where 
charge ordering will take place. We therefore believe that 
our variational calculation captures the basic structure of 
the phase diagram, which, however, might become dec- 
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FIG. 1: (color online). Upper panel: Condensation energy 
as a function of |(7|/f* for filling q = n/3 = 1/3. Note that 
t* = f\/d is the typical kinetic energy of the fermions and 
determines the Fermi temperature Tp. The inset shows how 
the superconducing order parameter. A, the deviation from 
equal densities, Sua = £> — 713, and 1/g scale to zero as one 
approaches the critical value Uc/t* ~ —1.774. Lower panel: 
Uc/t* as a function of the filling factor q — n/3. The phase 
diagram is symmetric to q — 0.5. 

orated by subdominant and possibly undetectable insta- 
bilities at lower energy scales. 

At r > 0, thermal fluctuations destroy the CSF order 
above a critical temperature. In 3-dimensional lattices, 
Tc is expected to be finite and related to the condensa- 
tion energy i^cond- For d < 3 dimensions, phase fluctua- 
tions completely destroy the long-range superconducting 
order at T > 0. 

The phase diagram in Fig. [1] parallels the famous finite 
temperature phase diagram of QCD where a supercon- 
ducting state occurs at large quark densities, correspond- 
ing to large kinetic energies in our case, while baryonic 
matter emerges at low densities, i.e., small kinetic en- 
ergies [1^. In QCD, however, the phase transition is 
believed to be of first order due to the long-range inter- 
action generated by gluons. Furthermore, unlike quarks, 
the 3-color ultracold fermions considered here (e.g., ^Li) 
have no additional flavors and spin degrees of freedom. 
The CSF emerging in our case has a non-trivial SU(3) 
color content and is analogous to the color superconduct- 
ing phase in 2-flavor QCD where only two flavors of light 
quarks are considered [20| . In the alternative theoreti- 
cal scenario of 3-fiavor QCD the su perc onducting state 
is expected to be color-flavor locked 21 1 . 

The variational analysis can be performed for all den- 
sities. We summarize our results in the T = phase dia- 
gram in the lower panel in Fig.[T] Because of particle- hole 
symmetry the phase diagram is symmetric with respect 
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to half-filling, g = 1/2. Close to half filling, Fermi surface 
nesting could lead to additional phases not captured by 
our analysis. 

Experimentally, the critical temperature could be 
reached by implementing adiabatic cooling in the opti- 
cal lattice [MliH. To leading order, this procedure leaves 
the ratio T /Tp invariant as absolute temperature scales 
decrease. From Fig. [T] we expect the CSF critical tem- 
perature to be Tc/Tp ~ 0.1 for the 3-color degenerate 
Fermi gas which has to be reached before the lattice is 
switched on. Realistic values for the dimensionless inter- 
action strength are in the range \U\/t 1 — 100. The full 
phase diagram can therefore be experimentally probed. 
Trion formation is expected to set in at temperatures of 
order \U\ ^ Ej^ where En w 0.7fj,K is the recoil energy 
of ^Li in an optical lattice [l3| ■ 

Maybe the easiest way to detect the CSF is to break 
the SU(3) symmetry to U(l) and detect vortices and the 
superconducting condensate fraction directly by pushing 
the system through a Feshbach resonance [uj. Further- 
more, it should be also possible to observe the phase 
separation discussed above: For equal initial densities 
of all three internal states, domains will form where one 
of the states has a lower density than the others. This 
imbalance can be easily detected by light absorption, as 
already demonstrated for the BEC-BCS transition in a 
Fermi gas with overall spin imbalance [ll[. Note that 
the system discussed here has equal total populations of 
all three hyperfine states, and the domain formation to- 
gether with a local imbalance occurs spontaneously. 

The quantum phase transition could also be observed 
via Bragg scattering [2^. With this technique, the dy- 
namic structure factor S{k,uj) can be measured which is 
a suitable quantity for detecting the supcrfluid ground 
state 0. In the CSF, several Goldstonc modes arise due 
to the reduced SU(2) symmetry of the ground state, and 
one of them (the Anderson-Bogoliubov mode) is visible in 
S{k, uj) [l3|- This mode will become soft close to the tran- 
sition as the order parameter vanishes and disappears in 
the trionic phase. 

The characteristic excitation spectrum of the trionic 
phase can be probed by "shaking" the optical lattice, 
i.e., applying a periodic amplitude modulation. This 
technique has already been used to determine the ex- 
citation spectrum of a bosonic Mott insulator 
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Deep in the trionic phase we expect a dominant excita- 
tion at a characteristic frequency lu = 2\U\ corresponding 
to the breaking up of trions, which becomes broadened by 
Fermi liquid quasiparticle excitations as one approaches 
the transition into the superfluid. 

Since neither the CSF nor the trionic phase depends 
on a particular filling, we expect only small modifications 
of our results due to the trapping potential or the ensu- 
ing inhomogencous density. Moreover, for U ~ Uc the 
Cooper pair size ^ will be small compared to the trap 



diameter R. Thus, the trapping potential plays a mi- 
nor role as in the measurement of the dynamic structure 
factor for interacting bosons Q . 
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